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1.  General  Introduction, 

The  next  sections  Introduce  a  treataent  of  probleaa  of 
statistical  estlnatior.  Is  which  aoa»  previously  developed  theories 
ere  extended  end  unified. 

The  foraulatlon  of  the  estimation  probl-s*  adopted  here  la  of 
the  general  kind  used  In  the  theory  of  estimation  end  testing 
hypnthjses  due  to  Eeynan  and  Pearson:  estimation  methods  are 
evaluated  in  terns  of  oroha jllltles  of  various  possible  errors, 

7 or  statistical  inferrnce  or  decision  problems  generally, the  w>st 
general  possible  fomulfttlon  of  this  !:lnd  Is  evidently  that  of 
"llxdley  (1);  there,  for  the  problem  of  deciding  among  k  simple 
hypotheses,  one  considers  lrj  a  logically  symmetrical  way  each  of 
the  k*k-l)  error  probabilities  pf,  *•  probability  of  adopting 
(when  using  e  given  inference  rule)  hypothesis  1  when  hypothesis  J 
Is  true,  lj*j  ,  The  formulation  sdopted  here  .’.a  equally  gerorel, 
but  introduces  also  ‘•he  particular  ordering  awng  hypotheses  which 
represents  the  {structure  of  any  given  parcwtric  estimation  problem. 
For  example.  In  a  one-parameter  astlnstion  problem,  the  whole  dis¬ 
tribution  function  of  an  ostlnctcr,  under  each  possible  value  of 
the  peremeter,  Is  d*alt  with  ratter  explicitly  and  not  •» r-rarirod* 
py  some  functional  such  a3  rwen  squared  error. 

To  this  formulation,  the  concept  of  admissibility  end  the 
decieion-theorotlc  method:  lue  to  Veld  are  applied  to  obtain 
characterisations  of  complete  daises  of  admissible  estimator*  for 
tsarsy  problems.  Because  of  the  triad  definition  of  admissibility  us*d, 
these  complete  classes  include  all  estimators  which  are  admissible 
vith  respect  to  particular  loss  factions  such  a»  aeon  squared 
error.  Tiros  the  nresent  theory  baa  theoretical  and  technical 


2# 

fir  estimation  theorist  beaed  on  different  fornolatioaa, 
a.- d  lxi  a  :>rral  tout  It  enbrace*  axoh  ti.oori»«*  fitoit  ssetio©* 
of  ttir  scries  of  papers  will  ba  readable  by  statisticians  tdM  are 

a.‘t  decision  theorist;,} 

principla  of  estimation  by  maximum  likelihood  is 
r»;  lenBllxcd,  given  exact  (non-eeymptotlo)  Justification,  and  unified 
w.ta  :h©  *:hj-ry  of  confldanca  regions  sad  tests  of  Hayaan  sad 
Ps.nucr.  frsa  porta  of  the  theory  utilise  primarily  the  method* 
of  the  l\tt»v  theory,  and  yield  sons  new  practical  techniques  of 
estimation. 

21ia  pr» reding  remarks  apply  orlisarlly  to  point  estimation 
croblcrts,  but-  the  treatment  adopted  unifies  point  end  ounftdenee- 
rogler  esrlittlon  nethoda,  and  incorporates  V*th  in  an  "omnibus" 
4-flrltiou  of  "an  estimate*  which  is  proposed  end  illustrated  as 
a  -rcc-lcnii.;  useful  device  as  well  as  a  theoretically  useful 
n  > tier. ,  lo?  problems  of  estimation  of  a  real-valued  parameter, 
such  or  entirete  Is  called  a  "confidence  curve"  end  is  a  representa¬ 
tion  cf  vo  for.ily  of  upper  and  lower  confidence  Units  for  the 
paraicter  at  each  possible  confidence  coefficient  (thus  differing 
at  nest  Lr.  f-.rr  from  the  "confidence  distributions*  de*erlbed  by 
Cox  ((2),  p.  ?63)), 

Sous  crc bier.*  of  sequential  estimation  are  treated,  delations 
between  asy'gtofcio  and  ncn-asffiptotie  theories  of  estimation  ere 
d«vslo;-e5  ir*  some  detail, 

2.  Cc  varies  fomulatlcas  of  the  problec  of  point  seilnation. 

b»  consider  bar*  pre blent  of  estimation  with  reference  to  * 
specified  exferimat  B,  leaving  aside  for  the  tin*  being  *11 
questions  cf  experimental  design  Including  those  of  tholes  of  * 


jiplc  sits  cr  p:*sioXy  *■  a*qpsnttol  asapling  nil*}  ocs»  definite 
_v  1  lav;  rule  is  assessed  to  b*  •pwlfiad  a*  a  part  cf  S*  let  S  •  £x| 
the  ssaple  specs  cf  possible  onteawa  x  of  tbs  «a»rt*int. 
to  ■tot*  on#  of  tbs  slwntary  probability  fraction*  an  S 
-  Let*  ere  as  possibly  true,  and  1st  il>«  [#j  tents  ths 

•  reified  parasiur  nan,  so  that  for  each  0  la  A  and  for  auk 


.beat  1  of  E,  tbs  probability  that  S  yields  an  oatcoas  x  la  A  to 


:lr»n  by 


Pro*  (  Ajd|  ■  |*  p{x,«) 


<bU)i 


&.r*  p  la  a  specified  measure  on  S.  (Vs  assume  tacitly  ham  and 
v-lov  that  ccnsi&s ration  la  appropriately  restricted  to  nsatnmbla 
i.‘tt  sad  fuactlur-t  only.) 

let  1*  lie)  be  any  function  defined  on  SL  (ax  important 
i  sc  la  X{*';  Ei)«  and  let  P  denote  its  range*  than  a  point  /• 
i-tirmtor  of  t  is  a  function  g*gCx)  defined  on  3  and  taking 
'..lues  in  P  .  ifbe  function  g(.)  la  called  an  ssticatort  gifts  a 
'.rscifle  observed  outcome-  z,  the  epoe&flo  rains  g(x1  la  called  an  ■ 

'•  tins  to. ) 

The  following  definition,  containing  as  It  does  a  tracer  of 
» ithf r  Tagus  toms,  seeaa  to  render  aa  precisely  as  possible  the 
Ml  i  ltultirs  zseaalsg  of  "tbs  satlsation  problsa*t  d  problem  of 
Mut-oatiraticc  Is  a  problem  of  choosing  a  good  estimator,  that  to* 
a  i  *4' tins  tor  g  vbieh  tends  to  take  raluos  does  to  the  true  best 
•^■Jzaom  raloe  of  Y« 

For  purpose?  of  coopering  alternative  ss  tins  tors,  the  only 
?.-»clso  interpretation  vfclcb  this  definition  allow*  to  srldaatly 
i'u  extremely  United  oat  in  which,  tsadsr  each  hypoths*i*  the 


rrset  value  k  *  t{9)  Is  eeasldered  eletsr  to  the  tno  nl«* 
w  1*  any  ether  value  |  f  lt«),  tot  no  definite  todptrlieM  M 

-  closeness  ere  possible  anocg  Hffwwt  iacemot  value*.  (Be to 

*  f 

at  a&  ordering  or  par  eras  trie  otraeturo  la  -A.  has  been  aatveod  aa 
et.)  Xn  Llndl#7*a  formlatloo  described  above,  this  Oaf lnltlo* 
.:»<*  to  a  necessary  prafaraaoa  for  ooa  oatlaator  with  oner 
robobilltlaa  p^  over  a  seoond  ona  with  arror  orofeaMlitlss  p|j 
*‘*y  if  <  py  for  all  1  and  j/i  and  alao  <  p^  for  aoao 

L  sad  3obo  Jjfi  .  However,  la  aoat  aatlaatioo  problaoa  tba  event 
Aa*  an  astlaata  la  precisely  aerraet  baa  typically  negligible 
probability  and  la  of  l&ttlo  Interest* 

In  order  to  obtain  a  definite  baa  la  for  aonparlns  estimator*. 
Is  necessary  to  specify  farther  tba  "closeness*  of  the  various 

-  correct  values  of  an  estimator  trader  each  hypothesis.  On  tba 
V-vrr  hand,  any  proposed  qoantltatlvo  neaetzre  of  slowta**,  or  of 
:at  or  loss  due  to  error*,  la  aeeaaaarlly  open  to  tetm  eritSdoat 
cat  It  Is  partly  subjective  or  arfeitnay  and  henoo  la  not  a 

o  roar  hi  y  satisfactory  fomulatlon  of  the  goal  of  "the  estlnaticn 

robiaa"  as  stated  above*  nevertheless ,  beginning  with  taplaao  and 

iaoaa  (cf .  Beynan  ((3),  pp*  9-lW  for  aa  interesting  brief  sketch 
of  the  therry 

tbs  history^ of  estimation,  and  reference?},  useful  foranlatlaaa 
'  the  estimation  proble»  have  baas  aade  In  tarsia  of  specif  is 
*  actions  adopted  to  represent  the  lose  dp*  to  each  possible  error* 
i'or  estimation  of  a  rsal-ralasd  parsreter,  the  use  of  tba  absolute 
alua  of  tJv  error,  introduced  by  topless,  was  replaced  by  Oat&M 
hj  the  squared  error  becauee  the  latter  proved  atm  trastaH* 
nthsnetically  and  provided  aa  equally  roaeoaabla  daflnlto  foesafta* 
•im  of  tba  oroblae.  Tba  use  of  loss  functions  la  astlnatim  ant 


other  lUtlttletl  problems  we*  glean  parti snlar  rn&ma&m  to  tto 

dK'.ilsa-yaorttl*  fornsOftiions  As  *a  told* 

Tb»  criticise!  that  ter  loti  fawtioB  adwM 

b«  soe*«hat  arbitrary  asw.t  to  to  aoawrti  for  aaagr  practical  «nd 
a*3r»t:c*l  pB?po*«i  by  oetias  U)  that  the  lars*  of  itntuttol 

thee./  ***d  techniques  to  afclsb  tfaM«  jfwglHa—  !— sa  let  Inatafto 
«s=y  estlnatloo  aetfaods  ahlsh  no  be  <eealaatot  Cmtlj  as  any 

without  necessary  reference  to  t£a  •artlcsitf  1m 
traction  adopted  orlclr.ally;  (b)  that  on  varies*  each  evaluations 
tbasa  netbods  ara  found  vary  omM}  and  (a)  that  sotetantial  part* 
of  fcli  body  o'  theory  and  technl^tes  fcava  baas  gacad  laaa  sensitive 
than  ri-*t  te  anticipated  to  aodarato  aftangas  Is  the  specification 
cf  tha  loaa  function,  as  that  in  assy  prof? gat  a  .Bfte"  eg  different 
VssscwMa  looking*  loaa  functions  will  la  ad  to  aahatmtially  tha 
aana  estinatian  aathoda. 

Such  forBulatlooa  dispose  of  tha  aagneneas  eg  "the  aatlaatloa 
problan*  by  representing  tha  Individ— 1  Who  mar*  aftto  Sftftaaoeoft 
by  a  forual  netol  of  a  “rational  eaooosU  naa*  aha  baa  (at  laaat 
isrlielt  in  his  patterns  of  latotiv*  behavior)  ft  atillty  fanatical 
defined  ovar  tha  possible  acteooaa  of  tha  iafteaeaeai  situation, 
fella  thaaa  foreiulatioca,  and  tha  theories  and  techniques  to  ahleli 
they  lead,  ara  axtraaaly  awM  and  Ulariaatiag,  ttaj  to  set  *—• 
to  aafcraca  as  nosh  of  tha  SatoitSva  oontoet  of  "She  eatlnatioa 
-roblesi*  as  ©as  r&r£t  wish,  and  they  latro&aoo  al assets  ana  al|Jst 
wife  to  avoid  or  poateoaa  —lag  *«  Tar  as  la  posalhlo  i»  tto 
iare lopaaat  of  a  sanaral  and  naafttl  theory  of  tatbatUa.  fhU 
ii— a  brae  parti ealarly  with  regard  to  the  altoctSan  to*  tto 
seise  tin*  rasearab  enter  sonier— t  not  with  idylsi  to  «te 


irnedlste  decisions  but  rather  «1%  4*T«loploc  taoeledge  end  «»ing 
estimation  methods  in  hi*  analysia,  Interpretation,  and  reporting 
cf  research  data;  hare  measurement  of  utilities  of  various  outcossss 
Is  rather  hypothetical,  a*  la,  la  Important  eases ,  the  possibility 
depleting  his  inf  ere  nee -evoking  situation  in  term*  of  more  definite 
decision  probleau. 

Even  whan  tbs  vagueness  cf  tha  estimation  problsss  la  dealt 
v  lth  by  adoption  of  a  loss  function,  typically  a  large  class  of 
estimators  remain  ainlsalble  for  reasonable  e^Aalde ration,  end 
selecting  one  of  these  requires  adoption  of  a  further  formal 
criterion  of  optimality  or  an  informal  comparison,  judgment  and 
choice.  Eor  estimation  problems  in  scientific  research,  the 
edvntion  of  any  nuch  formal  criterion  to  define  an  ootimsa  expected 
loss  function  of  an  estimator  seems  to  compound  the  somewhat 
arbitrary  or  subjective  choice  of  the  loss  function  itself}  while 
informal  comparisons  of  estimators  sen  often  be  made  in  at  least 
as  simple  and  satisfying  a  way  by  direct  consideration  of  error* 
rrobabilltlei  of  estimator*  as  by  consideration  of  expected  values 
of  loss  functions. 

In  general  it  seems  worthwhile  to  distinguish  as  far  as  possible 
Informative  inference,  as  a  basic  function  served  by  statistical 
nethods  in  scientific  research,  from  other  function*  served  by 
statistical  methods  including  those  represented  in  theories  of 
rational  decision-making.  This  distinction  is  not  rendered  c 
purely  formal  one  by  the  consideration  that  most  statistical  theories 
and  techniques  may  prove  useful  for  both  functions;  nor  even  by 
the  faet  that  the  nature  of  the  former  function  eaa  often  usefully 
be  explicated  (analysed  and  interpreted)  by  use  of  the  concepts  and 


forrriUtioo*  of  thaories  of  decision-mktng.  Tha  la t tor  net  does 
not  Larly  that  such  interpretations  exhaust  tha  nature  and  meaning 
of  tho  Informative  lnfereuoe  function.  This  la  not  the  place  for 
a  lota  lie 1  diaeuealon  of  this  very  general  methodological  qusstionj 
;'.o  :*> tte t  it  may  be  sited  that  there  are  prcbleaa  in  whleh  quite 
«i'.t  foi'ent  fomal  thaorlea  and  practical  statist* 'al  techniques  are 
appro iria to,  de ponding  upon  whether  an  Informative  or  a  wore 
*r**c  Tic  itilltation  {pel  la  adopted.  A  striking  example  la  provided 
by  the  problem  of  estimation  of  the  mean  of  a  multivariate  normal 
distribution,  and  the  formally  similar  problems  of  the  elms  a  leal 
iheiry  of  linear  estimation  (assuming  normality  of  errors).  For 
these  problems,  the  use  of  the  elassleal  estimators  for  oceh  eoe~ 
portent  or  each  parnnetrio  function  seems  generally  appropriate  for 
•us'r^ms  of  informative  inference,  and  their  use  *e  indicated  by 
torloua  formal  criteria  for  estimators.  Including  that  of  mean* 
sq  sared  error,  (3uoh  Justification  of  those  classical  estimators 
is  discussed  in  more  deVall  In  Section  5  below.)  It  has  been  proved 
by  Ctoln  (U) ,  however,  thut  for  the  problem  of  estimating  simultaneously 
Virec  or  more  components  of  the  near,  of  a  multivariate  normal  dls- 
tr  r-don  {or  three  or  more  independent  parametric  functions).  If 
>*>■*  o-ionts  es  a  loss  function  the  sum  of  squared  errors  of  the 
r*3'ectlvo  estliwtes,  then  (lie  classical  rstiaiators  are  inadnisslble. 

It  aeons  clear  that  tills  result,  striking  as  it  la,  does  not  at 
all  detract  frost  tha  resftmehlenese  of  using  the  classical  estimators 
for  informative  inference,  especially  since  infomation  about  eon* 
po  vita  or  parametric  f unctions  Individually  is  often  of  primary/ 
interest.  The  result  does  point  up  the  need  for  caution  in  souses* 
tlon  with  use  of  Ices  functions  to  represent  the  goal  of  Inf  or  native 
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iifartnc**  About  parameters.  Stein's  result  depend*  crucially  on 
*.Tt>  -rseiso  quantitative  font  speelfled  for  the  loot  function, 
tetter  with  the  uae  of  coespoua&ing  (by  Adding  their  Ioaa  function*) 
d  1  s  t  in  pul  a  kabl*  Inference  problem  which,  for  purposaa  of  lnforoatlve 
'-.fqrer.ee,  there  is  no  cLeer  r«uon  to  consider  la  ooabinatlon. 

*h»  usefulness  of  over-all  error  re  tea  for  a  f  willy  of  confidence 
.  t areal  estimates  on  parametric  function*  ia  not  inconsistent  with 
feet  that  the  no*t  u**ful  families  of  Interval  eatiaate*,  for 
.? orratlva  lnferencea,  conalat  of  confidence  intervale  each  baaed 
>i  a  classical  eatiaate.)  Stein's  result  oolnta  a  direction  for 
Isvolopnent  of  new  statistical  technique a  for  purposes  of  suceeaiful 
reliction,  techniques  which  may  differ  strikingly  free  the  classical 
s tins tors;  and  helps  to  make  clear  that  the  liferent  funotlona  of 
'  .lorrative  inference  on  the  one  hand  and  euceassful  deciaion- 
iV,  inr  on  the  other  will  souse  tinea  be  served  best  by  quite  distlnot 
•-  .eo-otioal  f  emulations  and  practical  techniques. 

Such  considerations  lead  us  to  develop  as  far  as  possible  a 
Veory  of  estinatlon  In  vhioh  (a)  the  notion  of  eloseneea  to  the 
.17  -cct  value,  of  various  incorrect  values  of  estimator^  1*  expressed 
i  a  precise  and  useful  way  without  Introduction  of  loss  functions 
similar  devices,  and  (b)  estimators  are  evaluated  In  terns  of 
-r  habilltiea  of  errors  of  various  sorts  In  the  style  of  the  Beyman- 
-arson  theory.  For  problem  of  estimation  0/  a  ral-valusd 
rare  ter  0,  such  comparison*  as  to  closeness  are  aval'-ble  in  as 
vie  us  way  between  every  two  lncor  ect  values  each  less  than  the 
srrect  value ,  and  between  every  two  Incorrect  values  each  c  roster 
.-'.iaa  the  correct  value;  this  leaves  open  only  the  comparison  of 
^correct  values  on  opposite  sides  of  tbs  correot  value.  Us  art 
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th  jji  lad  to  dersloo  a  tbaory  of  eeHnetloci  based  on  dlree^  con¬ 
sideration  of  the  v*~>le  dletribrtf  ttc  function  of  each  estimator 
under  each  hypothesis.  On  thews  tern*  ,  coo  estimator  can  often  but 
not  always  be  Judged  necessarily  bette a*  tzaa  a  second  one.  Savage’s 
discussion  ({?),  pp.  22U-225)  of  tcrloai  criteria  for  estimators 
la  unusual  In  lta  Inclusion  of  a  cri terit©  of  admissibility 

baaad  In  thla  way  spcu.  trae  wteele  e.d.f.  of  an  estimator. 
Systematic  usa  of  aueb  a  crltarlnr  aw  mas  sot  to  bars  bean  swde 
orovioualy. 

Apart  frtm  the  goal  of  doa*L=cfjr:~  a  tbwfy  of  estimation  In 
a  fora  which  scorns  appropriate  far  yjp>m  of  Informative  Inference, 
the  development  of  tha  present  taaegy  thMrttlctl  and  technical 
re  1 -sauce  for  theorlaa  of  •Jt.'avtlxi  baaed  era  other  f orculatlooe , 
since  the  present  theory  evidaetsly  iar-lnSea  all  other  theories  In 
a  forral  tans*.  A  knowledge  *=f  ala*  a nrnlag.lt la  class  In  the  present 
broad  sense  can  be  helpful  ahw  »"=•*■»  a^-proacaes  are  to  be  applied. 

?o r  exanple,  every  estimate  la  aarlsalale  lrlth  respect  to  a 

no an- squared-error  .on  fanctlae.  mt=rt  bo  admissible  In  the  ore  sent 
sense;  hence  the  search  for  a  .e.  ■wvtf-ratn  v  can  be  restricted, 

without  loss,  to  the  admissible  tint  •  eaeplete  class)  In  the 
present  sense,  (In  this  way.  a  Mrsirriy  cf  definitions  of  admis¬ 
sibility  (cf,  (6))  leads  to  a  «.  .  estsanilae  nested  hierarchy  of 

adr.l*  ? !  ble  or  complete  classes.*  drain,  a  criterion  of  estimation 
nay  be  shown  to  lead,  for  certain  r-otleaeg ,  to  estimates  which  are 
not  admissible  in  tha  pretart  saat;  sr.rrrr  resells  fsellltate  our 
appraisal  o  such  criteria;  e_r.  tSw  criterion  of  unbiasedness 
has  bs  n  shown  to  laad  to  irasdsf stills  sst!ss*ss  In  this  sans#  in 
sons  problems  cf  interest.  A  asmscrlxra  for  aholoa  of  aa  as  tins  tor 


10. 


f&ftj  t«*  iboun  to  l»i/,  ta  son*  class#*  of  problems ,  to  *stlnat*s 
vh  ch  s^e  always  »drl*«itlej  vh*n  this  occxtr*.  th*  reasonableness 
of  th*  criterion  i*  cor  firmed,  and  furthermore  any  a  priori  Intuitive 
attraet'vene**  of  tie  criterion,  to-*th*r  with  thla  conf irnatlon, 
nay  t«  a  satisfying  practical  baa  la  for  resolving  th*  sooetines- 
clfficult  rrobla-s  o.  choosing  an  estimator  fron  a  lor-e  adnfaslbls 
cl-533;  ur  der  f-.lrly  :«r.<.nl  condition*,  oaxlnun  likelihood  estimators 
can  be  ;iven  t  di  kind  of  Justification,  as  will  b*  Indicated  In 
a  later  rection.  i'in.ii'.j,  a  criterion  vhiefc  is  a  priori  attractive 
rcay  lead  to  an  e  stir  a  ter  -nlca  s-ens  unreasonable;  evidently  this 
indicates  that  sons  of  the  intuitive  content  of  th*  estimation 
yrccloo  Is  not  foltfnlly  express >d  by  the  given  criterion,  ts  dis¬ 
cussed  In  conn  sc  tier.  vlth  otelr's  res '’It,  Uso  of  s  brosd 

criterion  of  ad-.lsolbilit/  esn  ivsolvs  such  apparently-incongruous 
situations,  end  can  exhibit  s  variety  of  admissible  estimator*  from 
am  nr,  which  s  satisfying  chiles  n*7  b*  possible. 

?*  A-*-.l?slble  estimators. 

The  prater. t  socticr.  leal*  with  the  concept  of  admissibility 
of  an  sstl.TStor  of  s  re&l-valued  parameter  6.  (extensions  to 
s  :1  tlparamter  '-rot-lens ,  problem*  invoicing  nuisance  parameters, 
and  orstlsr.s  with  ct.-.er  para.*etrlc  structures  will  bo  given  in 
s.tcc  crr.t  s'c*. ir''s, )  >t  -CL  be  any  subset  of  the  rosl  lies 
(fir.its,  or  eountaily  or  unccoui.tably  infinite) .  The  family  of 
eie;*.ntary  prolsbillty  functions  p(x,9)  under  cor.sideration  has  a 
pararsetrle  struct jr*  only  in  that  each  p(x,9)  is  labeled  by  a  dif¬ 
ferent  reel  nrisr  9.  L*t  9*  ■  9*1x1  be  any  (measurable)  estimator; 
it  is  lsefnl  (as  will  appsar  below)  to  allow  th*  rang*  ®f  ®  to  b* 
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any  i’ibMt  of  the  clotura  -A-  of  jX-  (e.g.  If  iXls  the  whole  rttl 
line,  8*  nay  Uk*  th*  values  ao).  P or  each  possible  true  value 
© ,  the  use  of  an  estimator  0*  leads  to  certain  probabilities  of 
ovar-estlnatlon,  represented  by  the  function 

a(u,8,8*)  •  fprofc{8*(X)  £  ul©)  far  each  real  u  <  0, 

(_? rot(8*(l)  >  u|0)  for  each  real  n  »  0, 


The  function  a{u,8,8°)  Is  thus  defined  at  each  and  at  each  ^9  . 

For  a  fixed  0,  a(u,8,8*)  will  be  called  the  rlalt  curve  of  the 
estimator  0*  a«  0  . 

Definitions,  Por  a  cl*«n  estimation  problem,  an  estimator  8*  la 

called  it  least  as  Rood  as  an  estimator  0**  if  a(u,©,8*}  <  a(u,0,6**) 

i  or  all  SC-fL  end  all  0.  If  8*  s~d  ©**  sre  each  at  laaat  as 

,  good  as  the  othar,  then  a (u ,©,©*)£  a (u ,©,©**),  and  the  estimators 

j  are  called  equivalent.-  If  neither  of  ©*,  8**  is  at  least  as  gpod 

l 

I  the  ot’.ier,  the  t  n  estimators  are  called  not  conosrnble.  If  8  Is 

at  least  as  good  as  ©°*  and  if  a(u, 0,0*2  <  a(u, 8,8**)  for  sons  0  € 

;  and  some  u  8,  6*  Is  oalled  better  than  ©**,  As  estimator  8*  Is 

called  u  L-.lsilblo  If  no  other  estimator  la  better  than  8*.  The  class 
of  admissible  estimators  is  called  the  ndilaslble  class,  A  class 
of  estimators  is  called  complete  if,  for  each  estimator  outside  the 
dess,  there  is  a  better  one  in  the  class.  The  minimal  1  smallest 
cor- lets  class,  if  one  exists,  coincides  with  the  admissible  elas  , 

A  class  of  estimators  is  called  essential!?  complete  If,  for  each 
estimator  not  In  the  class,  there  is  one  at  least  as  c°°^  In  the 
class.  A  minimal  essentially  complete  class,  if  one  exists.  Is  a 
subclass  of  tbs  admissible  class. 

It  Is  useful  to  define  also,  for  each  0  and  0*, 
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}  •  Prosit  (X)  «  e|e  ]  -  Li*  a(©-t;®,®  )  , 

l  )  €— *0, 

i  >  c 

«.;*♦  ,$,*')  *  Prob  >  S',®  I  •  LI*  a(®e€j®,®#)  r 

(  J  €  — *0, 

€  >  0 

for  esc*-.  0  .  V^-en  reference  to  a  ^Iven  estimator  0*  1»  understood, 
.•c  ''ail  writ 9  sl-ply  a(u,©),  •[*-,»!,  or  a{©*,8)  .  The  function* 

and  a !©♦,©)  of  (  adalt  Interpretations,  as  will  b* 

respectively 

seen  l-'l-w*  they  will  te  called^  the  irvsr  location  function  and 
tlr.  w"  t  Ittc+l or.  fine  Mon  of  8*, 

In  :saj  oroblera,  e j tlna x>rs  for  which  Prob  ^0*(X)  ■  S(q|  >  0 
for  H  -Ill  he  found  not  useful.  Then  for  the  remaining 

estl-u.t-rs  we  hose  alt-,8)  =  l-a{4^,8)  as  ths  value  of  the  c.d.f. 
cf  »*il)  at  fc  when  0  la  true,  Zo  tea  such  estimators,  having 
c!f  er'r.c  location  functions,  can  bs  comparable;  for 
siJ-  .J,.1)  «  at-  ,9,9**]  Is  es-i*  ralcr.t  to  a(®e,0,9*)  >  a(®+,0,9**)j 
th.  s^-s  tia*.  r;Ittv»r  sstlctatur  Is  t»t  lesst  as  -,ood  as  the  othar. 

7;e  .orj  hrcid  and  “weak"  def  in' tior.  of  admissibility  adopted 
air. a  les  s  *.o  very  lar^c  adn'silblo  clashes  In  tyolcal  problena, 
r-^var.  It  do&s  -ot  sc  r.  unreasonable  to  conceive  of  the  p ruble* 
of  .jlnt  estimation  as  cne  In  which  the  Irvestlrator  chooses  an 
e«V.-st-~  on  the  basis  of  con ■»  1  d' rs i i on  cr  the  risk  curves  of  all 
ertlrat-rs  In  soes  asser.tially  cr~~r\n te  class.  In  principle  this 
ecu'id  r**Ion  shojld  be  complete,  but  of  course  toe  practical 
cc  rterr'-rt  of  this  can  be  at  least  a  mre  or  less  extensive 
ft  .-liar*. t7  with  the  essentially  co-pl etc  clsas,  dovelonod  ty  study 
f  a  varletv  >f  pirtlealmr  estl  atoms,  nosslbly  strenytfcened  by 


1?. 


ion.i  pte..-<Tal  theoretical  considerations  ,  and  perhaps  alao  by 
refsrence  to  one  or  several  loos  functions  and  criteria  of  ootinallty 
whleh  nay  aeon  mr*  or  lass  appropriate  in  particular  problems. 

Such  an  approach  is  lnlt'ed  neoassary  if  the  undesirabla  features  of 
formula  t,ions  based  primarily  on  loss  functions  sre  to  be  avoided. 

It  ra*  be  feared  that  such  an  approach  entails  awkward  and 
formidable  task*  of  comparisons  of  risk  curses,  and  is  impractical 
to  carry  out*  It  will  ba  seen  bclou  that  this  is  not  the  casa. 

In  nost  decision- theoretic  f  orrrul  **■ 4  cno  of  statistical  problems  , 
a  reul-velued  risk  function  r(0,0*)  is  -’eflnsd  for  each  parameter 
point  and  each  decision  function.  In  the  present  formulation ,  we 
associate  with  each  pair  0,0*  a  set  of  ar^or-probabllltlea 
a(u,0,O*),  u^O  .  These  respective  error-probabilities,  for  eaoh 
fixed  0  end  C  ,  nay  be  regarded  as  component#  of  a  vector  denoted 
cy  r(0,0*)  *  j  ,  the  components  a(u,0,O*)  having 

ir.d3X  u.  (we  could  define  a (0,0,0*)  »  0  for  formal  convenience.) 
Then  r(0,0*)ls  cn  example  cf  a  vector-valued  risk  function  (6). 

Era-rle*  Lot  X  be  normally  distributed  with  'lrJmown  aeon  0 
and  variance  1,  wits  J\  -  |o|-co<0<  co  J  *  The  classical 
estimator,  based  on  one  observation,  is  8(x)  •  X.  Ths  error- 
probabilities  of  this  ertinator,  when  o  ■  1,  are 


S(ufi,6)  - 


l(u-l) 

J  "  T 

l-i(u-l) 


for  a  <  1  , 
for  a  >  1  . 


his  risk  curve  is  g-ephed  in  Figure  J.l. 


A  second  estimator,  ©‘‘lx}  ■  x  ♦  1,  has,  when  0*1,  ths  following 

error-probabilities,  Illustrated  lr  Figure  3.2? 


•  fo,l  ,©*) 


I— ! 

l-](u-2) 


for  u  <  1  , 
for  a  >  1  . 


figure  3,2 

Cnr  wishful  ix tuition  goal  in  choosing  en  estimator  would  be  to 
Ki~irixv  sirKj.tsnsou3ly  all  ordinates  of  such  c orres  (for  »n  6, 
end  for  «11  V<S)  since  each  ordinate  Is  the  probability  of  as  error 
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which  wo  with  to  avoid;  of  course  this  goal  cannot  be  re  11  ted  in 

#  A 

non-trlvlal  problem*.  The  estimator  0  Is  superior  to  0  with 
respect  to  ell  errors  of  undar-estlmtlon,  but  Is  correspondingly 
worse  with  respect  to  error*  of  orer-estlnc tlon.  Prom  this  stand¬ 
point  neither  can  be  called  better  than  the  other;  they  are  not 
coop arable. 

A  third  ostlnator  is  the  apparently  trivial  ono ,  0  (x)  ss  ♦  oo , 

whose  srror-probabllltlss,  whan  0  «  1,  are  Illustrated  In  Figure  ?.?t 


tluA,#**)  •  (o 

l1 


for  n  <  1  • 
for  a  >  1  • 


L4fu,f,6M) 


This  estimator  {but  no  "saallor*  one }  Is  perfect  In  avoiding  error* 
of  under-estimation (  but  Is  as  bad  as  possible  with  respect  to  over- 
estimation. 

This  example  Illustrates  the  technical  usefulness  of  our 
slight  generalisation  of  the  usual  definition  of  an  estimator,  which 
allows  an  estimator  to  talc*  values  not  only  In  but  throughout  it* 
closure  _fL . 


M* 


•  V _ 


V 
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It  *111  shown  below  (a)  that  c*ch  of  these  thro#  estimators 
is  adnls Jible:  (b)  that  Indeed  ovary  non-decreaslng  function  ©*Jx) 
of  t  It  an  adnis-. Ibla  estimator;  (e)  that  a  avlnlml  ©eeent tally 
complete  class  of  estlrwitors  la  constituted  by  tha  right-continuous 
ncn-doc  Teasing  functions  o#(x)  of  xj  and  (d)  that  aoone  oatlnatora 
which  are  "rwuian-ur.blated*  (that  la,  which  over-estimate  and  under¬ 
estimate  wlti  aqual  probabilities,  for  aach  ©),  tba  classical 
aatlnator  Is  unifc— »ly  beat  (that  la,  6  ninirJLroa  a(u,©)  slarul- 
tanooualy  for  all  0  tr ■*  oil  or^). 

U«  Klemntary  theory  of  admissible  estimator*, 

A  ujafbl  part  of  ttvs  theory  of  adnlsslblo  aatlnator  a  of  a  real- 
valued  paranoter  can  be  developed  conveniently  by  nee  of  tbs  theory 
of  ono-silcd  testa  of  hypotheses  due  to  Heyvaa  and  Fear son,  la 
fact,  for  problem*  hnvlag  a  alcpl©  struct-ire,  tha  complete  theory 
can  bo  doveloped  la  this  way.  In  this  section,  eon*  useful  methods 
and  results  are  Introduced  under  simplifying  assumptions)  later 
sections  will  contain  nor©  general  results,  such  as  complete  classes 
of  adnlsslblo  »*»—*t*r(,for  some  of  the  problems  considered  here* 

J;  ,1,  Relations  between  estimation  ar.d  one-sided  testing  problems* 

Any  glvon  ©3tlL.ator  ©*(x)  of  a  real-valued  parameter  9  can  be 

used  In  ttie  following  vay  to  define  s  tost  of  the  hypothesis 

Hs  0  <  ©  ,  vhero  9  Is  given,  sgalnat  H* :  ®  >  t 
O  o  *  o 

If  0*(x)  «  ©_  is  observed-  Infer 
o 

that  0  «  fl0  ("accept  H")  ) 
if  e#U)  *  0o 


thet  0  *  9_ 

■  O 


is  observed.  Infer 
("rejeet  H*)  . 


Similarly,  0*  esa  be  used  to  define  a  test  of  Hi  8  <  8#  against 

h'i  8  >  t.  aa  follows l 
o 

If  ©*(x)  <  0o  ,  lnfar  ©  *  ©0  } 

If  ©*(x)  »  #0*  lnfar  *  >  ©#  • 

If  0*  la  ruch  that 

(l)  Prob  J  ©*(x/  -  0o|e  ^  -  o  for  ell  ©  €  -A-  # 

then  the  two  testa  are  equivalent  for  testing  either  hypothesis  B. 
Tor  any  estimator  0*  satisfying  (1),  let  A^  »  £xj©*(x)  <  ©Q 

the  acceptance  region  of  such  a  teat.  The  Type  I  errora  of  such 
a  tost  hire  probabilities 

1  -  Prob  |  *0  Jo  ^  «  a(®o,0#0*)  for  each  0  «  j 
tbs  Type  II  errora  have  probabilities 


Prob 


|  ©|  -  av0o,0,0#)  for  each  ©  >  ©0  . 


For  tasting  Hi  0  <  0Q,  the  Type  II  error  when  8  ■  8^  has 
probability 

Pro*  [ \,o  |«0]  -  «<V*  ®o*  ®W)  "  ®o'  ®#) 


For  testing  Hi  0  <  ©o,  the  Type  I  error  when  ©  »  ©0  has 
probability 

1  -  Prob|AeJ©0  j  -  a{0oe»  ©0.  ©*)  -  l-a(©w-,  ©0,  ©*). 

In  this  way,  for  any  estimator  0#  which  satisfice  (1)  end 
whloh  takes  values  only  in  -fL  ,  each  of  tbs  error-probabilities 
of  0*  u  is  estimator  can  be  irterprete©  as  an  error-probability 


It. 

of  a  one-sided  tost  baaed  on  Such  In  terpre  to  felons  give  the 

following  useful  partial  answer  to  the  qu«*tlon  whether  any 
given  estimator  la  adnlsslblai 

Legaa  lr  If,  for  a  specified  family  of  densities  f(z,8),  8€-fl,  ©*(::) 
la  any  estimator  satisfying 

(a)  Prob  j©#U)  -  oje]  “  0  Tor  all  8^  and  6  €  A.  , 

(b)  ©*(*)  trices  values  In -fL  only, 

(o)  A q  m  jx  j  8*(x)  <  la  the  acceptance  region  of  a  teat 

whloh  is  admissible  for  testing  H:  8  <  ©0  against  n' »  9  >  ©0# 
and  for  testing  E:  8  <  8^  against  H  :  0  >  9q  ,  for  eu.h  &Q(  Ji- , 

fci«»n  Is  an  air!  is  It  le  estimator. 

Proof:  If  C*  satisfies  (a) -(c)  mod  If  la  better  than  C ' , 
then  for  soiae  H  and  some  8*€  9*4  ®Q,  we  have 

a(0o,  ®’,  8*°)  <  a(0o,  8*,  0*),  while  for  all  fi(A,9  /  80# 

we  Mve  a(8Q,  0,  fl'^)  <  *(9^,  8,  ©*),  But  then  |x|9**(x>  <  9Q? 

Is  the  acceptance  region  of  a  test  of  H:  0  «  9  which  la  better 
.  •  o 

than  j^xl8#(x)  <  CQj  ,  contradicting  the  assumed  admit slblllty  of 
the  matter  test,  (A  tost  Is  called  a&clsclLle  If  no  other  test 
has  all  error-probabilities  at  least  as  small,  with  at  least  one 
strictly  smaller.) 

For  any  estimator  8*,  since  8.  <  99  Implies 

|x|8  (x)  <  c  [  x!e  (x)  <  82|  ,  ths  acceptance  regions  ^Afl  j 

defined  as  above  constitute  c  non-decreasing  sequence  of  sets  w4 th 
index  8  €  A.  . 

Many  admissible  estimators  can  be  constructed  by  the  device 


of  detcr-i-.tr*;  ,  for  ai^h  Cof  SL  ,  r*n  admissible  acceptance  region 

A„  f rr  m  oypotbesle  H:9  <  9  ,  In  aueb  a  way  that  the  secuence 

o  ° 

j  Is  non-dccreaslf  g  In  ®Q.  A  einple  method  for  such  construc¬ 
tions  is  given  bj  the  following 

Corolla-y  1.  For  a  specified  family  of  denaltlea  f(x,9),  ©t •£-, 
let  r(x#w)  oe  any  function  satisfying 

(a)  f  r  -»ach  6£ /i  #  v(x,©)  Is  naas  o-able  and  v(X,C)  has  a 


c.d.f 


(b)  fir  each  xfS,  v{x,0)  is  dec  re  i  sing  In  0  and  v(x,9)  3  C  has 
a  (unique)  solution  Oc-^-j 

(c)  for  each  ®0£  il- ,  £xiv(x,®0)  <  o|  la  the  acceptance  region 

of  a  test  which  le  alniealble  for  testing  Hx  Q  <  ©0  and  Hj  9  <  , 

foe  each  JiiZ,  let  0*(x)  be  the  solution  O  or  v(x,©)  »  0  .  Than 
©^  is  an  admissible  estimator. 

Proof:  3tr<-e  ^xlvfx,©^)  <  0  j  *  |xj»#(x)  <  ©Q^  ,  the  corollary 

foll-yus  from  Leans  1. 

1;.?  rj.'.otc-.g  liPallbocd  ratio  condition. 

Sir'- ose  tho  family  f(x,9)„  ®€  D.  .  admits  a  real-valued 
9;ffioi:ai  statistics  t  •»  t(x)  satisfying 

(A)  t  has,  for  ecch  ©t-4^,  a  density  f'inctlon  h(t,9)  with  raspeet  *~ 
to  sxoe  ei-siro  A'*  V(t);  and  ©«  <  9-  implies  that  h(t ,0_)/h(t ,9. ) 
is  increasin':  In  t.  c  *  A 


If  wo  *..*  tho  nssumptlc  •  that  t  ons  s  continuous  distrlbutl >n  for 
each  ©,  vs  cm  oeflne  t(0  so  as  to  satisfy  J  ■  Prob  |t'I)  <  t(9,a)|©j 
f ( r  ef  oh  ©£  and  each  -t »  O  <  d  <  1,  Let  e(0)  be  any  function,  M 
si  ch  tut  t  {©,-{©) )  Is  continuous  and  atrlctly  Increasing  In  0. 

Then  t-oc  coucltlons  cT  Corollary  1  are  net  by  v(x,9)  »  tlxl-tl®,*:©)). 

In  fact,  tbs  saceotar.oe  region  {for  testing  III  ©  «  9  or  Hs  9  <  8  ) 
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Lq  •  |x|t(x,©0)  <  0  |  ■  £x|t{x)  *  t{0,-<(0))j  la  vail  know  to 

minimize  simultaneously  tha  probabilities  of  arrora  of  Types  I  and 
II  subject  to  tha  coalition  Prob  j  |®0|-  It  follow* 

from  Corollary  1  that  tha  estlaato r  0#(x),  defined  for  each  x€S 
as  tha  solution  0  of  -  t(x),  la  an  admissible  estimator; 

further,  amor.^  all  estimators  with  the  sa-ae  location  functions 
a{©  9,  ©*)  *  l-a(0  ♦  ,  0,  ©*)  -  -*{©), 

©#(x)  Is  uniformly  best  (that  Is,  3*  minimizes  simultaneously  all 
error  probabilities  atu,9),  u  /  Q,  (Equivalently,  every 

lncrcaslnG  function  ©*(t)  tahlng  values  In  -A-  la  an  admissible 
estimator. ) 

Taking  *(©}  =  w,  0  <  w  <1,  9*(x)  la  familiar  aa  an  upoer 

confidence  Unit  vita  coufliouc*  coaff iciest  {*rd/er  a  lower 

confidence  Unit,  v'fca  coefficient  a). 

}  Qer.erc-llced  raxlmr«llkellhoo3  estimators. 

Por  c.  flv«n  family  f(x,0),  ©€-A  f  lat  A(©}  and  A[0)  be 
any  two  functions  satisfying  A{9)  >  0,  a(©)  >  0,  ©*-4(0)  f 
and  ©  -  A(0)  €-A-,  for  each  ©C -A-.  Assume  f(x,©)  >  0  for  each 
x€3  and  each  ©€/l,  and  let 

▼  (x  ,9)  -  1S&-£&£JL£12U  -  1o}  4*Ml  .  o(9,  w(©))  , 

<^(©)  ♦  <3(0) 

where  w(Q)  satisfies  0  _<  «<(©)  _<  1  and  0(0,  .*{©))  satlaflea 

w(0)  -  Prob  |t(X,0)  <  0]©J 

for  eeeh  ©C-A.  In  cany  problems  these  conditions  can  be  satisfied 
by  suitable  choices  of  A (9) ,  J  (©) ,  and  •<(©),  and  the  resulting 

Vv 
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function  v(x,8)  will  also  satisfy  tha  conditions  of  Corollary  1, 
which  we  now  ass'ins. 

To  so#  that  a  sat  Ap  »  «  0  |  is  necessarily 

aocop  tar.es  region  of  ° 

tno^a j&isalble  tost  of  !;  ®  J  8ft  and  of  3:  8  <  8#  ,  not*  that 
t(x,90)  Is  a  nonatena  function  cf  tha  likelihood  ratio 

f (x,^  ♦  A(°p) Vf (xt0Q  -  it  follows,  by  tha  Eeyman-Pearson 

» 

lerrm,  tnat  gives  k  tost  of  the  simple  hypothesis  H^x  8  *  ®#-  A  [®c) 

o 

a,,alut  the  sLipl®  alternative  H^:  0  *  8^  ♦  ^{0^),  with  mlniinxn 

Type  II  error  anong  all  tests  wifi  ths  sane  or  smaller  Type  I  error. 

Since  ?rob  >v(X,Co)  "  Oj©  |  ■  0  for  each  86-^-,  this  best  test 

Is  in terr.lna  1  essentially  uniquely;  hence  AQ  represents  a  test 

o 

which  Is  adnisslble  for  testing  H:  8  <  0o  or  Hi  9  <  8fl. 

It  follows  by  Corollary  1  that  an  admissible  estimator  is 
given  by  0*(t)  d&flnod,  for  each  r.iS,  ss  the  solution  8  of  v(x,8)  *  0  . 

If  in  tbs  above  definition  of  t(x,8)  wo  consider  for  each  O 
a  seqier.se  of  choices  of  A(©)  and  &(8)  such  that  £{8)«-  ^(8)—*  O, 
v«  obta’n,  as  n  fomal  Unit  of  the  first  terra  of  v{x,8),  log  f(x,8), 

provided  that,  for  each  xf 3  and  8  6  -A.,  this  derivative  exists. 

Leaving  as!d»  this  lir.' tin.’  procsss,  it  Is  convenient  tc  consider 
directly  an  alternative  ieflrltlon  of  t(x,8)  as  follows! 

v(x,ei  -  X  log  r(x,8)  -  o(c,  w(®n  =  .  0(8,  w(e)i, 

**  f(x,8) 

assuming  axister.es  of  the  derivative.  Here  Q(8,w(8))  is  defined 
as  before  so  that.  Tor  each  8,  «t(0)  •  Prob  £v{X,8)  <  0|8^  .  Ths 
acceptance  region  A^  ■  £  *j^(Xf80)  <  oj  la  clearly  equivalant 

to  one  based  on  the  inequality  f  *  (x,80)/f  U,©^)  <  0{©o,w<©o)). 


zU 

T. . la  If  well  known  to  be  the  acceptanoe  region  or  the  locally-beat 
tost,  of  six*  1— of  the  hj-pothesl*  Hi  0  ■  0Q  stalest  H*l 

(and  to  bo  the  rsjectlon  region  of  the  locally- best  teat,  of  also 
«<(<*0},  of  H:  8  ■  «o  against  H*  t  0  <  0o> ,  provided  that  Tlx, Si) 

satisfies  -^r  J  f {*,«}  d+i  *  X  f(x.®)  do  for  each  (measurable) 

V  V  *¥ 

VCS .  if  s(x,®)  satisfies  the  conditions  of  Corollary  1  above,  than 
the  following  estimator  Is  adnlJ3lble:  Tor  each  x,  lat  6*(x)  te 
the  e  ;l'itlon  0  of  v(x,o!  ■  0,  that  la,  of  -^y  log  f(x#3)  *  0(®,w{O). 

Among  all  estimators  with  tha  same  location  functions,  eneb  estimator! 
mini. -ire  er—or-probailli tie  a  a(u,6,0*)  for  u  In  tha  neighborhood 
of  0,  for  each  CC-O.. 

T.jt  estl-Atora  c-biilr.od  In  this  section  arc  garsralljKitless 
of  the  -laxirrun-ltkellaocd  estimator  3(x)  whloh  Is  defined  as  the 
solution  of  the  equation  log  f(x,Q)  *  0.  Thus,  under  the 
conditions  rontloned,  the  swLxlrrxa-likrllrood  estimator  is  admissible. 

It  has  the  location  functions  e{0-,  ©,S'  —  l-a(0a,  6,  *)S  *«(0), 
where  ✓  (©)  ■  Prob  jV*  (1.  ,0)/f  (X  ,i}  <o|o|,  where  rt(x,«)  *  ^  f  (x,©)# 
If  f  (X.^Vf  (X,0)  has  a  sjmmetrical  distribution.  Its  median  will 
coincide  with  its  ram,  which  is  E(f  *  fX,6>)/f  (X,0)  !©)  H  0,  giving 
w(0)~  ,5.  I'.ore  gonsrallj,  If  x  is  a  srrple  of  Independent  obser*  mo¬ 
tions,  the  normal  ap-rcxlxction  (bared  or.  tho  Central  Limit  Thooraw) 
will  often  r?' 1 t  relatively  well  for  Dock  rate  sample  sixes  to  give 
•<(9)  *  .5  as  an  approximation  to  the  location  function  of  $  . 

U. U  'fr  sanies. 

The  first  two  axarrles  telow  Illustrate  that  tV  method  of 
Section  >».2  can  often  be  spoiled  conveniently  aa  a  case  of  tha 
methods  of  Section  ^.v. 
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txawpisl,  ;ornal  —an.  Ut  x  *  (y^,... 7#)  ba  a  inplt  of  n  independent 
observations  fron  «  noneel  distribution  with  ino»*n  vs-rlanes,  •« 

(T2  ■  1,  sad  urdcnom  swan  8,«oo«8<aoe  Then 


-a,  -  *  £  tr.  -  •>* 

fu,a>  -  (2m  e  1 

1-1 


Lot 


t{x,8)  »  "  X-l*-*.0-!  .  0(0,  •<(£)),  where  ■*  (0)  1* 

90 


•  given  function.  Then 


▼  {*,0}  «  n(y  •  0)  -  0(8,  ^(0))  •  ny  -  nO  -  <Jn  J 
—  1  n  T 

•fcjrt  y  -  »  y.  and  $(u)  1»  tho  standard  nomal  c.d.f. 
1-1  1  X 


Then 


▼  {*,©)  clearly  satisfies  conditions  (ft)  end  (c)  of  Corollary  1, 

Condition  (b)  Is  net  if  .*(0)  U  suoh  that  8  ♦  -i-  f  (-<(0))  is 

increasing  In  0;  fts  a  Increases,  this  condition  beccws  a  less 
restrictive  on»  on  .<<(0);  (b)  is  o hr  1  curly  satisfied  If  ^(8)=-«,  C  <  «<  <  1 
for  all  0,  2c r  aach  function  u(9)  »9tlefYin«  Cb)  ,  A",  a  rcissible 
eetlaxtor  ®*(z)  Is  defined  as  tho  solution  8  of  v(x,8)  -  0,  that 


la,  of 

s 

0  ♦  -=- 
>Tn” 

OumtiEg  the  solution  ty  Qfy),  this  givos  ©*(x)  -  Q(y)j  Q(y}  **T 
be  ai<y  increasing  funs tl an  of  y  If  «*(©)  Is  suitably  chosen.  Per 


^  («<(©))  •  y 


a (9) —  *  ,  this  beoones 


©#(x) 


7--i- 

T5 


V  -1 

{  (-)  . 


ca  upper  corf  i  os  ace  licit  of  oonf  Idonc*  coefficient  !•*>*  (and/or  a 


1 ower  eonftedenee  Halt  of  coefficient  a)*  Since  the  function 
v(x,0)  la  tech  of  thate  cases  eleo  meets  the  condition#  of  Section 
14.2,  each  of  these  estimators  is  uniformly  best  anon#  all  estimators 
with  the  same  location  functions  a(0  -,©);» l-a{0  ♦ , 

Taking  w(0)=|  gives  «*U)  -  &U)  •  y  |  for  this  location  function, 
the  estimator  obtained  la  Independent  of  the  particular  value 
assured  for  <j~^  }  hence  the  classical  (maximum  likelihood)  estimator 
Is  unlfornly  best  aacnj  all*median-unblasedP  estimators  of  C  even 
if  <p2  la  not  known. 

Rxxrnle  2.  TTornal  variance.  Let  x  «  (y^ .yQ)  be  a  scmle  of 
c  Independent  observations  from  a  r.oroal  distribution  with  known 
no  an,  say  41  *  0,  and  unknown  standard  deviation  ®  *  a~  ,  0  <  CP  <  ao  . 
Then  _  ^  1  »  2 

f(x,0)  •  ]SJ  uirtf-2)”*  6  2c-2  1,1  Xi  e  tot 


v(x,0)  «  —  -j  log  f(x,0)  -  O(O^c(0)),  where  w(0)  Is  a  given 
0  » 


function.  Then 


v(x,0)  «  -?*  (  ■  ■%  -1)  -  3(<j“ , 
0  rr£ 


2  1  2 
vhere  a  •  -  ZZ  T[  • 
a  1«1  1 


For  a  given  has  tha  Chi-square  distribution  with  n  degrees 

yC~*  2  2 

ol  free  doss}  hence  0(d“#  •*($“))  •  *n)  e  where 

is  the  lower  w.point  of  the  Chl-equare  distribution  with  n  degrees 

1  *y2 

of  free  dost.  Thus  v(x,Q)  ■  for  ax  ample, 

w(  <3~)  H  w,  then  v{x,0)  satisfies  conditions  (a)-(c)  of  Corollary  1. 
Taking  -<{  <T)  2  ^  civet,  as  the  solution  of  v(x,9}  •  0,  the 


25, 


svsdian-jnhlfsed  ••tin* tor  odf  0“* , 

0~  «  (T  tx)  ■ 


Similarly,  the  nelian-unbissed  sstlasfcor  of 


1* 


C'2  •  (?>*  -  *2  n  „  * 

ft  f  •  y 

/  2  «  ^  .  '-'2  •  2 
Whon  n  i *  not  email,  n /  X  *  1  #  •*w*  T' m  *  m  *  * 

9  n,.5 

vhor#  js  the  cl*a i leal  unbiased  estimate.  [Tbms«  relations  «r* 

considered  in  nore  detail  In  Section  5.11  below.)  In  each  of  these 

cases,  the  acceptance  mgions  Ag  -  {xHx,0Q)  <  0  }  are  equivalent 

O  »  .  '  2  "N 

to  those  obtainable  as  In  Section  U.2,  ^  i  (T0  " 


Hence  each  of  the  estimators  considered  is  uniformly  best  snong 
all  estimators  with  the  sane  location  functions. 

Tho  following  two  examples  illustra'-e  the  method  of  Soctlon  H«?» 
2r^—  lo  3.  Logistic  w.enn.  Let  x  •  (/^,...ya)  be  s  sanple  of  n 


Independent  observations  from  s  logistic  distribution  with  unknown 

wan  8,  Prob  (f  <  y!®?  -  1  <y  -  «)  •  l/£  ♦  e*  *  ).-«,<  y  <  co. 

<•  >  X  ,  -Cy-*)/,  -(y-*\2 

-  oo  <  8  <  CO  I  I  has  the  density  function  y  (y-®)“  0  /\^+C.  J  • 

Ttklnc  &(®)E  & (#)5d  >  0  and  •‘(0)  S  «*,  0  <  -  <  1  ,  lot 


r(x,e)  -  ^  [log  f  fx,e  *A)  -  log  {[x,Q  -£>  J  -  0(®,  *) 

“  TK  [  5.  (log  *  *  *A5**  loc  ^1*1  -  •  ♦  **5  * 

| 

Condition  (o)  of  Corollary  1  Is  satisfied,  since  iJ/’Cf-O- A)/l^CT-#+ A)  j 


la* positive  rondos  variable  with  a  ecr>tln>K*us  c.d.f.  Condition  (b) 
is  satisfied,  since  y  |fl  -  d  -*)/  tvj  -  2  ♦  A  )  1*  decreasing 
In  0  free  ♦  oo  to  -  on,  and  3(0,  •«)  la  inc'epenient  of  t» 

Condition  (e)  Is  satisfied  (slnee  ^xlv(x,80l  <  0  ^  Is  trse  aeoectenca 
replan  of  an  essential lj-unlquelj  date reined  best  test,  of 

0  •  d#  -  *  against  R^x  0  *  ♦  A)  ,  Hence  an  aOalsstble 

estlnator  0*(x)  la  givsn  hjr  the  solution  0  of  v(x,8)  »  O  •  Ue 
base  by  rymetry  that  3'8,  »  0,  ao  that  s-i  adnl'-lblo  naulca- 

unbiased  estlnator  la  "Six),  the  solution  0  of 

£L  £log  ^(jj  -  0  -  A}-  Id*  'vjf  (jj-  ©  ♦  A)  J  ■  0  . 

This  estlnator  and  Its  risk  curves  depend  upon  the  particular 
▼aln  d  chosen)  the  error-probabilities  a(0  -A,w,8*}««  a(»*A,s#c9i 
have  a  nlnlnlsed  oocorson  value  for  all  9  • 

Taking  the  "Halting  case  A  — 0,"  we  define 

v(x,8)  -  -|5  f  (x,8)  -  G(Q,a) 


8)  -n-  0(8^*)  . 


The  conditions  of  Corollary  1  can  again  be  verli  led.  To  detemlr* 
Q(Qf*)t  note  that  when  9  la  true,  ^  (T  -  0)  haa  the  unit  r^ctan-pilr.r 

distribution)  the  c.d.f.  of  ^ _ "jp (Ij»  8)  can  be  calculated,  or 

anproxlr.ated  closely,  except  for  extreae  values  of  <*-  and  very  snail 
n,by  a  nortaal  distribution,  as  shown  in  £?,  pp.  2}tU~2U6>3.  Since 
SfT  •  8)  and  Var(  ^  fl  -  8))  •  ^  ,  vs  have  by  the  oorsal 

approximation  0(8,0  i  N-*)  • 


Senes  the  locally-bost 


!  ' 


estimator  8*(X)  with  location  function*  *<»-,W)£  !-«{•*  - 


1*  th*  solution  0  of 


XT  (Tj-o)  -  §  ♦  §  o(o^)  ;  §  ♦  £  4T  $  ~lw  . 

By  ijmtrj ,  O(ti  ^)  *  0,  *o  that  tha  locally -b#*t  swdiar.-cntlasea 
estimator  coincide*  with  tha  naximaa  likelihood  estimator,  and 


i*  th*  solution  of 


£  ^<7,  -0)  "  f  . 


Solution*  of  th*  latter  two  equations  nunerically  are  easily 
obtained  by  me  of  tables  of  th*  function*  ^  (u)  20  • 

Exanpla  1^,  Laplac ean  wean.  Let  X  ■  {y  )  ba  e  skbtI*  «*f 

1  n 

n  independent  observations  frow  a  Laplacean  (double  exponential ) 
distribution  with  unknown  swan  0,  -oo  <  0  <  co  ,  with  density 


function 


For  any  A>  0,  let 


h(y  ,9)  -  |  e 


-If-®! 


-oo  <  y  <  co 


r{x,®)  *  -jrj  Jloc  f(x,©+d)-  log  f(x#0-A)J  - 

•  27T  l)  J  -  o(«^c(c>). 


He  note  that 


ly-®-dJ-iy-«eh|  m 


2d  if  0  <  y  -d  , 

2(y-®)  if  y-d<  9  <  y* A  , 
C**  ify***©. 


•ad  benoe  -2 <  XI  ( I)  «  24a  for  all  x 

1-1  x  1 

Sine*  Prob  <  9  -  A  |®J  ■  ^  6  *  the  of 

a  -  »4 

baa  a  Jtnp  of  £  )a  at  ewh  e-d 

Its  rano,  aad  Is  continuously  Increasing  between  la  at-  *rt-- . 
Bsnce  0{0^(©))  Is  well-defined  if  -«{©)  satisfies 


(|e  )  «-*(o)  <1  -(Je  )“  rax  fcii  o»  if  *is,  t  * 

0(9,*)  la  Independent  of  9,  since  the  distribution  of  '.'-4  1: 
independent  of  Oj  by  ayjnetry,  G(0^}  -  0.  A  staple  errq -:t*.  *.*->• 

gives 

—a  .a 

Var(|T-G-A  j-jY-Ooil!)  -  8(l-e  -^e  ).  *  *.  say;  tU  n 

for  n  not  very  small  sad  *  not  coctreae,  the  norrrsl  ep-r''JL.irf  tie. 
to  the  distribution  of  v{X,9)  gives 

QM  ^  (*). 


Condition  (a)  of  Corollary  1  la  net  satisfied  by  »{*.•>,  rut  vr 
resort  to  Leans  1  to  prove  the  admissibility  of  t~s  *  stinst^r 
defined  by  use  of  v(x,9)  t  For  any  *(9)  bounded  •-  ars/a,  L-.j 
such  that  condition  (b)  of  Corollary  1  1»  satl  efled  by  r(e,4'  ,  * 
Is  easily  verified  that  the  estimation  ©*(x) ,  defined  «s  the 
solution  9  of  v(x  ,#)  -  0,  satisfied  the  condition*  of  Len*r  , 
and  hence  Is  admissible. 

The  r  idisn-unbissed  estimator  0{x,  obtained  u  s;l*.  iio- 


(which  Is  easily  solved  numerically) ,  depends  upoc  the  partleulc. 


29, 


value  L  c'm*en;  the  err«*r-j>robetillti*e  a(0~^fer8)  »  a(8sA,8,  •) 
!«'«  *  ni.il.Ml £«'*  coxier*  tc!j4  f:r  all  8  . 

Tnl  in  *  the  •llni- ir*g  e*fa  A— -a  D,*  ve  itttin 

rfn.Jl  -  I(y  >  6)  -  £  I(yf  *  9)  .  3'8^f8))  , 
t«i  1  l-l  1 

v*  «>r«< ,  far  arjr  relation  R,  the  indicator-function  1(1)  la  defined 
35  I  S)  “1  if  B  la  true  Rnd  1(f)  ■  3  If  H  Is  felts.  ?hus 


n 


2 —  Ity.  *  0)  -  2H.  I(y.  <  8)  la  ths  nunber  of  observations  y, 
1-1  1  1-1  1  1 

exceeding  0  *inis  tbs  r umber  if  observations  lass  than  Oj  with 

probability  cos,  ths  observation*  y^  have  a  Jistinct  values,  and 

nay  be  orde-ed,  T <1>  <  yf2j  «  <  T(q)  • 


Then 


a. 

If 

0  < 

y(l> 

|n-l. 

If 

9  - 

y(l) 

'  n-2, 

• 

•  * 

+-*■ 

y(l)< 

c  < ; 

• 

• 

-n+1. 

If 

9  - 

7  (a) 

V  -a. 

jf 

9  > 

7  In) 

easily 

sect 

i  that 

the 

(2)  , 


lccaliy-bsst  tsit  of  1:  8  <  0^  apslnst  H*s  6  >  9  -  of  site 

o  o 

1  -  -CO  *  -ur  Sl5  (»•  given  by  the  acceptance  region 
<T  u*0  * 

i“.}-  I*1* 

=  1  -  ~  (")  ,  0(8^c(8))a  a  ♦  1  -2*  , 

n  a 

we  hare  t(x,0)  -  JZ  Kf*  >  «)  -  XI  !(▼,  <  «)  -  (a  ♦  1  -  2r)« 
1-1  x  1-1  x 


with  rvds.Ui;  ore,  ▼  *,©)  «  C  vl’i  hare  a  unlqo#  solution  ©, 
r.ar-nly  ©*[x*  ■  ?{r)*  "I’l*  estimator  satisfies  the  conditions  of 
J>rnt  1,  rail  so  Is  rtal«s?ble;  anon.’  all  ettluetors  with  tha  s  mm 
location  1  unctions,  It  minimizes  the  errur-probcbillties  a(u,Q)  In 
nsl-^-bortood  of  ©,  for  erery  ©.  If  n  is  ode,  o’!*)  »  j  »  y 

(___ 

the  sar?;le  median,  is  an  adctlssible  zaedian-unbiased  estimator. 


5.  T«*  lisn^nblsssd  est.  Instore, 


A  oert  of  "t*  tUr>i*.t«.dly  ea^ue  coal  In  "the  niti/es'lon  problsn 
Is  oxprerrsf.  In  tie  not.' on  that  for  aaeb  ©  tha  distribution  of  an 
ostir-ator  s' c.jld  bars  0  ao  &  "typical*  or  "ce  ltra!"  ▼nine  In  aosis 
srrao.  jv s*  11 jcus; lo.u.  of  th#  use  of  atatistics  to  describe  die- 
trio. tin -j  •  e':o  clenr  tJie  simple  point  tlutt  tsere  la  no  Index 
("ii-jrntr r}  cf  ..oo  lc-c  .tlc-n  of  e  distribution  whiGo  Is  unlq-iely 
rra.ser.n  iif.  ;  or  ^er-erel  ceecriptlve  purposes.  For  the  « '  tiuatlon 
r-oMm-  ecus  d‘i‘fd  ;m  rs ,  the  use  of  the  criterion  (picoosed  by 
Brovr.  [lj  J  cf  -.i-dlar  -u';t  insed  (exact  or  apnroximte) ,  to  specify 
suit- hi ■»  c-*:torin<»  cf  a  ^int-estlnator’s  distributions,  ssems  et 
lo us t  as  svisfnetory  ai  urj  alternative:  Ar.  estiuntor  ®°(x)  of 
a  n -l-.al  h-J  p.vr  -r-e te r  9  i :  called  radius-unbiased  if  for  each  9 
Its  '  ro.>«  hi! !  ties  of  evt  res* lnatlcn  and  ^oidereatlnntlon  are  equals 

•*  aj©  -,©,9*)  for  each  ©  6  -A-  . 


Ai,  ri'.v’tr. tecs  of  .tot  Itr.-'inbUiec  estimators ,  which  seams 
p* rt  J c  j_xrly  appropriate  for  our  primary  purpose  of  conveying 
irfomnti'u  aoo:t  psraiatnrs,  is  a  property  of  Invariance*  If 
i*  (rJ  is  f.u;  Alen-ur.b!  ised  estimator  of  ©,  then  each  strictly 


no  no  tone  of  f  auction  *(©)  has  the  aedlac-rcnblaaed  estimator 


?ls 

The  noafc  viosly  used  erlUrlon  of  loettloo  for  MtlaitAn 
Is  of  oonrso  ntir~g.bUMdn«H|  ths  lsttor  tons  will  bo  ut4, 
whoa  necessary  tc  ovoid  posslblo  temlaologleal  confusion,  la 
ploee  of  tbs  usuiJ.  tom  unbiasedness.  Oablosed  es lino tors  lock 
tbs  proportf  of  !ovorlanco  described  obovs  (except  la  the  rsstrlc tOu 
coso  thot  1(°)  to  say  llnsor  function).  Ibis  seeas  to  bo  a  dis¬ 
advantage,  ot  lekst  in  principle,  for  applications  to  aodels  of 
experiments  In  w-  ich  oco  paraoeter  hos  o  single  significance  for 
tbs  structure  of  tho  n: dal,  but  where  It  Is  natural  to  consider 
several  different-  functions  of  tho  poronotor#  ooch  of  which  bos 
o  distinct  noanir^f'J.  interpretation.  A  s lapis  example  Is  tho 
standard  dovietic-n  <f  of  o  no  mol  distribution;  <y-  and  tbs  vorlonco 
(f-2  hovs  distinct  Interpretations,  *nd  it  is  oenstiaos  desired 
to  consider  estimates  cf  ssch  in  tho  sens  contort.  For  such  purposes 
it  is  dcslroblo  to  define,  If  possible,  good  estimators  of  eeeh 
persraater  which  or*  consistent  with  tho  ratheeaticel  relation 
between  the  na:*enstero. 

A  esc  nd  reason  fer  considering  alternatives  to  the  naan- 
unblasednoaa  criterion  for  our  present  purpose  is  thot  this  criterion 
s sens  sonawhat  o:ia  to  criteria  based  on  loss  functions,  use  of 
wMeh  we  have  set  out  to  ovoid  oa  for  os  possible. 

A  third  and  perhaps  strongest  rouses  is  that  this  criterion 
soaotlnes  forces  the  us a  of  an  estimator  which  could  otherwise  bo 
strictly  improved  upon  frees  tho  standpoint  of  admissibility.  A 
familiar  exscrlo  is  tbs  problem  of  estlnetlcg  a  oos^tonont  of 
vorlonco.  Hero  the  obvious  Iriprovaeant  of  replacing  a  negative 
ootiaoto  by  tho  value  ssro  eon  bo  node  only  If  the  erltorioss  of 
unbiasedness  Is  dropcod.  On  the  other  bend,  la  ccroblssss  where 


9*  satisfies  *(®-f9,0*)  »  s(0«j0#0*)  «-  */2  on,  for  *xa*q?le, 

-O.  a  [ojo  <  C  <  ®  |  ,  9*  my  bo  redefined  as  soro  oo  s ay  x  for 
tfelsh  It  is  negative,  resulting  In  general  In  an  lnprorsoect  without 
altering  the  •edlaxwunbiasedneas  of  0*. 

The  most  Important  use  usds  of  the  principle  of  assn-unbiased* 

ness  seen a  to  be  in  the  develoosant  of  the  theory  and  techniques 

of  linear  estimation.  For  nany  purposes  the  bajlc  as  sumptions  of 

that  theory,  which  concern  only  the  means  and  covariances  of 

observational  errors,  are  supplemented  by  a  normality  as  i-mption. 

'Jhe never  the  latter  assumption  Is  added,  ue  can  (ae  lndlcstsd  In 

2xanp  1*  1  of  Cent  ion  k  above)  dispense  with  the  Jus  tif !  cation 

usually  given  for  the  classical  as time tori  of  linear  regression 

theory  which  lncluda  the  man-unbiasednass  criterion,  and  Instead 

reccesaand  the  classical  es  tins  tors  on  the  following  basis,  which 

aeons  superior  froa  the  present  standpoint  for  both  theoretical 

and  practical  purposed  the  classical  as  tins  tori  are  (a)  nadian- 

onblased  (and  hence  have  the  lsv&rimne#  property  described  above), 

probabilities 

end  (b)  arsong  all  such  sstiaatan,  they  nininixe  slrr.il tone ously  all  /, 
of  over-esfciaatlon  and  under-sstlr-atlon  of  every  par ane trie  function 
Which  is  •estimable*  (as  defined  in  that  theory).  If  this 
Justification  for  tbs  classical  estimators  Is  adopted,  the  use  of 
**  an- mbi&eednvs*  properties  remains  essential  at  the  level  of 
technical  development  of  the  theory  and  techniques,  but  does  not 
play  any  role  at  the  level  of  basic  Justifying  criteria.  The 
theory  of  linear  estimation  without  normality  assumptions  Is  not 
strictly  comparable  with  the  present  discussion,  since  it  is  based 
oo  «n  incompletely  specified  isodel  for  the  observational  errors 
(only  first  and  second  aments  being  specified)  while  the  present 


approach  Mi'jnf'i  fully  specified  probability  nodolt  p(x,8)f 
however,  the  preceding  comments  on  the  important  special  coo#  of 
normally  distributed  errott  se^m  of  some  relevance  for  tho  nor* 
general  theory. 

A  second  extensive  area  of  aae  of  the  mean-unblaaedneas 
crltorlcn  is  in  asymptotic  thoorlos  of  estimation.  Dovevar  this 
•no  is  typically  nade  with  reference  only  to  asymptotically  normlly 
distributed  estimator*.  Tiers,  me  with  tie  linear  e  a  tins  tors  Just 
discussed,  and  lnueod  wherever  a  problen  has  essentially  the  struc¬ 
ture  of  the  problem  of  estimation  of  the  mean  of  a  normal  dlstrlbu- 
tion,  the  criteria  of  raecr.  and  msdiaa-untlasedness  are  generally 
eatlsfled  b7  the  -ana  estimators!  It  aey  then  be  considered  a 
isatter  or  choice  which  (if  either)  criterion  Is  preferred  and 
adopted  as  a  Justifying  criterion,  and  wtleh  ia  to  be  considered 
an  entailed  yrcuerty.  fa  more  detailed  discussion  of  sou®  aspects 
ol  asynptotic  estimation  theory  uiU  be  given  in  a  later  section*) 

An  important  and  dialuct  part  of  the  estimation  theory 
developed  in  the  following  sections  concerns  median-unbiased 
esfcimstors,  particularly  admissible  ones.  whi\e  this  section  has 
described  certain  advantages  of  nediaa-unblasecooss  as  a  criterion 
for  point-estimators,  it  vil)  he  r -called  that  our  orograa  ia  not 
to  us*  a  theory  of  point-estimators  as  a  proposed  solution  of 
"the  estimation  problem*,  but  to  use  satisfactory  polnt-e  stir*  tors 
•nd  confide ree  limits  at  various  confidence  levels  Jointly  to  fora 
omnibus  estimators  called  "confidence  curves*  which  will  be 
proposed  as  relatively  satisfactory  solutions  for  many  estimation 
problems.  An  Important  additional  advantage  of  smdlan-unblaeed 
point  estimators  la  that  they  fit  well  Into  thla  oro-raa. 


:4- 

Zar  coming  the  ’eveloonont  of  theory  tnd  techniques  of  median* 
ir,l>i  •  tad  point,  osti-atioi.  It  Is  useful  to  not®  the  followings 
Ev.-ry  -zy*  er  ocnfidor.ee  llnlt  with  confidence  coefficient  ,$  (which 
is  alec  a  l:>Jtr  confldri**  Unit  with  the  sue  coefficient)  la  a 
r»  - It  i-nt  U »?-i  sstlrtto.*  .with  nlnor  qualifications).  Title  simple 
ob:e~f<»t  lo:.  lenit  us  ti  dopt  for  our  oumoBes,  first  of  all,  the 
ccr^idaralle  ardy  of  '..js?  end  techniques  of  estlrsstlon  by  e.'d* 
fir> i-~  lirltr,  and  wore  generally  to 

cc;.-.  I5er  '-i  pr  It.tlslc  a*.,  ainls^lble  estlrsitcrs  with  location 
fujctlors  ==.  al<ief0)  S  ,5  • 

Vhf,  f  cl  lowing  cor.wnts  co-cplenent  the  definition  of  rwdlan- 
«l tie  moss  p’vjn  above  t 

If  any  esti-jator  a*  satisfies  Prob  »  <»je^  *  0  for  ell 
Q,  t mn  C*  If  •'tdian-un'.lased  If  and  only  if 

;9}  ■  a($+;«, 0*)  »  ^  for  each  0  €  . 

:i3tir.at:>rs  iatlsf--ir.r  Prob  |o*  *  6  J  >  0  for  acne  9 
and  Q1  t.ill  ir.  in<cnl  not  be  redlan-unblaued*  ?or  exanple,  for 
tor  >'nc--.isl  distribution 

“  '”)  C.(l-0)a“*,  with  0  <  fl  <  1,  the  range  of 

etch  ^tir.ator  G*(x)  is  n  set  of  *t  nost  n+1  points  In  the  closed 
unit  interval.  >~n  e  *  1  -*.{©♦,« ,C°5  except  at  points 

in  t!w>  rar ,;e  of  o*;  ar.d  a  (©-,0,0°),  a  (©♦,©, O9}  aro  continuous 
except  at  thus*  points,  where  discontinuities  occur*  Hence  ©*{t.) 
cannot  be  oedi  an -unbiased, 

fls=r»toc*x3  of  fi:  tributlons  f(x,0)  dees  not  necessarily  imply 
non -existence  of  nedl&n-ur.blased  estimators,  If  S  •  |  x|  is  a 
discrete  sanple  apace #  it  la  possible  to  ec-ploy  is  a  customary  way 


am  aa^wntad  aanpla  ipaaa  S*  ■|{xly(x))j  ,  vfcare  y(x)  la  an 
obitrrtd  valuta  of  am  auxiliary  ran  does  variable  Tlx)  whose  ooo- 
tlnuoua  distribution  may  do pend  upon  tba  observed  X  but  not  upon 
8 .  Then  estimators  of  tha  font  ®*(x,j(x))  may  b*  nedlan-unbissed 
In  problama  for  which  no  8#(x)  ia  median-unbiased.  Such  augmented 
aanpla  apacaa  S*  ara ,  la  fact,  fomally  Included  aa  poaslola  oaaaa 
of  S  throughout  our  general  discussion,  Thay  ara  naaful  technically 
and  theoretically  to  give  a  formal  unity  to  thaoratlcal  developments 
An  estimator  ©*(x ,y (x) )  whoaa  values  depend  In  an  essential  way  on 
the  value  /  (x)  of  a  randomisation  variable  Tlx)  nay  useful  for 
sane  decision  or  prediction  applications,  but 

It  seena  clear  (in  tba  writer's  opinion) 
that  such  estimators  should  not  be  used  for  Informative  Inference 
purposes  even  though  It  is  sonatinas  useful  to  consider  then  In 
the  fomal  dovolopesenfc  of  estimation  theory.  It  follows  that 
exact  attainment  of  median-unbiasedness  will  sometimes  be  lneor- 
lis tent  with  the  purpose  of  nalcicg  Informative  inferences. 

In  soma  problems  with  oontlnuo *e  densities  f(x,0),  medlan- 
unbiased  es  lmtors  exist  but  are  all  Inadmissible.  Por  example, 
in  the  estimation  of  tho  mean  of  a  normal  distribution  {ttxsmpls  1 
of  Section  4  above) ,  if  we  tales  /l  •  ^0)0  <0  <  oo  |  ,  then  the 
classical  estimator  modified  In  the  natural  way, 

0*(x)  -  (  y  If  y  £  0  , 

l  o  if  y  <  o  , 

la  admissible  and  la lunlfomly  best  st-soag  nedlan-unbiased  estimators 
But  if  ue  talas  -A-  •  |  8jG  5  9  <  co|  ,  the  stese  estimator  is  aAcla- 
slbls,  but  the  condition  of  swdlen-unbi  sadness  fails  just  at  8  »  0, 
steps  a CO-,0,8*)  •  0  while  a(0*,0,8*)  ■  j  an  estimator 


©**<*>  -  f  f  If  7  2  0  . 

(  -«  If  J  <0  . 

where  €  la  a ny  positive  mnb«r,  Is  twlltn^mtUMd  bat  Inadnls ilble* 
It  Is  useful  and  natural  to  define  t  ie  ->ellan-blas  of  any 
estinato r  0*  at  9  as 

B!0,0*)  -  Prob  ^0*(X)  >  «|o|  -  Prob  ^  C*U)  <  «|o^ 

■  a!©- ,©#0*)  -  a(9-*9,0*)  , 


so  that  "poai tl-/e  aedian-biac*  •irnifiea  a  larger  probability  of 

ovsreatinatlon  than  of  undcreatinatlon.  In  sons  problens  it  la 

useful  to  cons Ida*  estimators  which  *nlnlnize  |B(fi»,9*)I  for  0  €  .XL* 

la  sons  sense.  Far  •xarq le,  tha  modified  classical  oatinator  ©* 
of  the  n -rool  neti  given  above  is  adnlsslble,  and  among  admissible 

•atl-TBtors  non*  Is  strictly  batter  vlth  respect  to  nadl-n-tiaa , 

since  any  adrlsoiole  astlrator  0*  (x)  with  |B(0,9*5j  <  B{0,©*) 

gives,  for  sooa  9  >  0,  3(9,0*)  «  3(0,9*)  •  C. 

Ac  estimator  0  vri'.l  La  celled  approximately  median- unbiased 
If  <J{©, 0*)  la  close  to  zero  for  all  9  6  -fl .  la  acne  problem , 
such  aa  thoaa  wlt.-s  discrete  distributions  f(x, 0),  it  Is  useful  to 
consider  admissible  estirators  vhle.i  ninlr.lze  tha  maximum  of 
|3(©,©*)|  for  0  € -A-.  Examples  are  given  below. 

Despite  these  necessary  qualifications,  the  property  of 
ned ion-unbiasedness  renulns  a  guiding  criterion  for  point-estimators 
whlca  It  Is  useful  to  consider,  along  with  the  admissibility 
criterion.  In  deselcpl eg  estimators  whieh  stay  be  useful  for  ashing 
Informative  Inferences, 

Por  additional  comanta  on  various  criteria  of  unbiasedness, 
see  Broun  (9}  and  Savage  ((5]r  p.  2hH).  for  a  decision- the ore tie 
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approach  to  such  criteria,  eee  Lelraum  (l!)}. 

$.1  Baat  nalltn-ur.hlaaeA  estimators  In  stapla  iUndgd  troblaaa. 

The  simplest  standard  problems  of  aatlnatlon  ara  these  In 
which  tha  family  of  densities  f(x«0)»  ®  € ,  satisfies  tha  monotone 
likelihood  ratio  condition  (A)  ol*  Section  lu«i  above.  For  tha 
problem  of  estimating  the  naan  of  a  noraal  distribution  {with 
known  or  unknown  varlanoe),  tha  classical  estimator  I  «y  vaa 
shown  (In  Section  U.  above)  to  be  the  beet  modlan-iuibiased 
estimator  when  -A-  la  the  real  line,  (Other  caaas  of  JX  were 
discussed  above  In  the  present  section.) 

$.11  formal  variance  or  standard  deviation. 

In  the  problem  of  Example  2  of  Section  U.H  above-.  It  i.-na  shown 

2 

that  the  beat  stedlan-unblaaed  estimator  of  a  normal  variance  <j~  is 

6~ 2  *  .  whare  •  n  /  • 

and  similarly  for  a  normal  standard  deviation 

<T~  ■  a  k^  , 

2  2 
where  a  la  tha  usual  unbiased  eetlaator  of  a~  baaed  on  n  decrees 

of  fracdon. 

Table  5.1  gives  tha  values  of  k^  and  k^,  for  various  n, 

which  can  be  used  to  compute  or  f  from  values  of  tha  classical 

18  and  1  <  k^  <  1.06 

for  n  >  6,  this  nodlfleation  of  the  claa  leal  estimators  is  a 
quantitatively  minor  one  exoept  for  small  n,  and  for  many  purposes 
It  will  suffice  to  take  the  approximate  values  "  a2  snd  CT  m  • 


estimates  a  or  a.  Slnoo  1  <  k^  <  1.02  for  n  > 


;1. 


axe apt  fop  snail  n.  Figuro  5.1  graphs  of  tha  function#  k2 

and  k^  for  o  <  1»0  • 

Proa  tba  standpoint  of  criteria  for  ••tL-.atora,  If  tlw  cz ;  tarla 
of  adtolaalbllltj  and  ■adlwv-uhbiaaadnaas  aro  adoptad  for  this 

prcblan,  ti»  lat^r  relationships  show  that  tb*  clas ileal  oatlnatora 
y2  and  a  aro  J  latifiad  aa  aary  eooTanlect  and  cloao  approxima¬ 
tions  to  tha  optL-al  ones,  axca.:t  for  snail  n* 

Than#  -'nlatlonxblps  proeida  a  Justification  for  uaa 
of  tot  classical  astinators,  axrcnt  for  srall  a,  which  aa  we 
ga  ns  rally  nor*  satisfactory  (da.plta  tha  approximation  laxolxad) 
than  th»  usual  ona  ha  sad  on  nean-unbiasadnasa.  lbs  na^nitooa* 

or  tha  mdian-tolss  of  tha  usual  a  a  tine  tors , 

B{<r2,»2)  s  B 1<T,s)  -  Pvob^a2  »  cr2\  -  Pr=b  (a2  <  0~2\  <r2  £  , 

ara  Independent  of  <J~  |  they  aro  shown  In  Tati  a  5.2  for  parlous  n. 
For  axanpla,  for  n  »  70,  s2  undax-sthT-tes  with  probability 
.511  -  .50  f  |(.022). 


r/ri.i  l.i 

(jtj^:x:rrs  fci  ccrpnrco  best  r702AH-m»iAn>  E3Tiw.ns 
OF  THE  VAH  arcs  OS  STASDAir?  33V1ATIOB  0?  A  KOWUl 
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DioruEimoi,  phot,  values  of  teg  clasmcal  gstuiatgs  . 
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£•12  Poisson  wt>.  Ut  x  ■  b#  a  saaspls  of  a  Independent 

observations  fron  a  Poisson  distribution  with  onknowo  nesa  •, 


0  <  0  «  as  j  ttea 


f  (i )  ■  Frob  |  •  (y^ *« •  •  Jjj  *!  | ’•  I 

satisfies  the  waotom  lilcallh^xl  ratio  condition  (A)  of  Section 


4.2  ,  with  tbs  sJTflelent  atatlatle  a  ■  |  y^  dlatrlbutod 
according  to 

b(s,0)  -  Prob  j^Z  "  *|°  j  a  C  (nO>*/*l»  *^A.2 . 

By  a  aloplo  generalization  of  Lama  1  (dispensing  with  assumption 
(a),  which  does  not  hold  for  non-randodzod  estimators  whan  f  (x,9) 
la  discrete),  It  can  ba  shown  that  aaoh  non -decrees lug  function 
0*(x)  of  a,  taking  non-negative  values,  la  an  adniaslblo  estimator, 
and  Is  unlfoaaly  best  anong  aatloatora  with  the  sans  location 
functions.  Aaong  such  estimators ,  wa  can  cboosa  ono  for  which 
|B(O,0#)  |  la  generally  relatively  ascii,  as  follows:  For  each  ®0  »  0 
(following  tha  nethod  of  Sactton  U«1  without  tha  restriction  of 
condition  (1)),  wa  seek  a  test  of  S^s  6  <  CQ  and  a  test  of 
H2*  8  ■  8o*  **®*P®«tlTa  acoeptanoe  regions  ^x|s  <  *,  |  ,  ^s!i  <  s^ 


*1  2  *2* 


not  naoassarlly  Integers,  oho  son 


so  as  to  nlninlse  tha  maxima  of 


J  .  |$-Fr<*jz»,j|«0]  I  . 

It  la  anally  verified  that  (following  Section  4*1)  this  leads  to 

a  re«*“»d  sequence  of  acceptanoa  regions,  for  all  O0  >  0  ,  and  tbs 

following  eorrsspondlag  ee tins tori  For  each  a  »  0 ,1,2,...,  7(a) 

a 

9a  to*  value  of  0  for  vlilch^la  the  median  of  2  in  the  precise  sense  th- 


TABU  5.3 


,3>« 


APPSOXEUTKIjr  HEDIAE-tniBIASIE)  3STBUTOR  •>  0?  P0ISr>03  IHUB  6  • 
n  * 

s  •  2H.  j,  •  total  »  n  b,  vhsra  •»  •  cLm  ileal  »»tUnU. 

i»l  1 

6  •  approximately  nadlao -unbiased  e  ■  tlrna^a. 
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frob  <  i|#  ■  9(t)| »  fWb 

Such  raluoa  of  Z(t)  aro  uiUx  datsrainsd  by  ut  of  tablos  of  tha 
Poisson  distribution.  and  ara  illustrated  la  Tabla  5.3-  1  single 
such  tabla  suffices  for  all  sanple  iltai  n,  a  Inca  the  distribution 
of  a  depends  on  nO  bat  Dot  on  a  and  0  separately;  banco  tba  tabla 
gires,  for  aach  t,  tba  value  of  a 5(s),  which  is  to  be  divided  b y 
tha  sanple  also  n  occurring  any  particular  application. 

It  will  ba  aaea  that  *0 (*)  diffur-s  only  slightly  froa  tba 
claasloal  eabinator  C(t)  ■  s/a  I  for  0  <  s  «  . 

*  s  nS(a)  <  nO(s)  <  a  ♦  0.2  . 


>  sjo  a^(«)|  • 


Figure  5.2  and  Tabla  5.1;  eoepare  tha  oadlan-blaa  functions  of 
«*U)  and  0(e) j  again  tba  differences  ara  alight.  Thus  for  aoat 
purpcaoa  tha  clsLS-ioal  aatinator  $(*}  vill  $trr«  as  a  ©orrranisnt 
and  close  approximation  to  C(s).  Fran  tha  standpoint  of  criteria 
for  estirvitore,  those  comparisons  provide  a  Justification  for  da*- 
of  the  clasnloal  estirator  (aa  being  atkslatlbla  and  basing 
ap-rozi-atcly  r.inl-dsas  nsdian-bi&s  soong  non-rand aal sod 
ad~-isslble  estimators)  which  seem  generally  wore 

satisfactory  then  tba  usual  Justification  (based  on  mao-unbiased* 
ness). 


5.13  Blno-lal  nc-.t.  Lot  x  ■  (y^,...yn)  bo  a  sample  of  a  Independent 
Bernoulli  observations,  Prob  ■  l|oJ»  9,  Prob^T^  •  0{0 1  •  1-0  , 

when  0  Is  unknown.  0  <  0  <  1  ,  Then,  proceeding  a a  la  tba  foist  on 

a 

case  shore  m  obtain  tba  sufficient  statistic  a  ■  jj  with 
tbs  binoalal  distribution 

h(s»«)  •  frob  j  S  ■  *|«j  »  (£)9*(1-9J®“*  .  a  *  0,l,...n. 

Tor  each  senple  aim  n.  aa  estlnator  «f(a)  can  bo  dotomlnod  which 


bu  alninun  wilu^lu  In  the  mm  mum  adopted  Sa  the  fetiiM 
case.  T*ble  5.5  glree  a  a  eh  estimates  0{*),  for  stable  also* 

□  •  3,5,10,  and  20,  In  eaaparlaoa  with  tb*  el~.sieal  estimate* 

6(a)  ■  s/n.  For  a-2,  8(a)  m  2f(s).  It  will  be  nm  that 

jo(z)  •  0(a) |  «  .016  for  n  >  5,  and  je(a)-  $(*)|  <  .007  to r  a  5  20. 

For  n»10,  tho  median-bias  of  tha  olaaalaal  estimator  &•  ooaqparcd 
with  that  of  %  In  Tabla  5.6  and  Figaro  5,3.  For  n*20,  tho  same 
conp orison  la  glvan  In  Tabla  5.7  ar.d  Figaro  5.V.  Again  all  of  tha 
differences  aro  all^it. 

sad 

Thus  if  tha  estimator  0(a)  la  adoptad  on  tha  criteria  that 
It  la  s&Uaslblo  and  has  "Intrw  median-bias  among  aoo* 
randomised  adaiaaible  aatlnatora,  than  far 

many  purposes  tha  classical  estimator  3  will  aerre  as  a  convenient 
and  close  approximation  to  "S’.  In  this  way,  use  of  *ae  class loal 
estimators  receives  a  new  juatlftcatlan  which,  deplte  tha  approxl na¬ 
tion  Involved,  seen*  generally  store  satisfactory  than  tha  usual 
Justification  based  on  moan-unbiasedness. 

6.  Acknrr^lqef—^t.  Tha  writer  is  grateful  to  Kr.  Leslie  Zurich 
for  computing  anl  preparing  tabla  a. 


PI3UR2  5.3  (Illustrating  Tablo  5.6)*  Hollao-bin  of  clan 3 leal  ootlnotor  5  of  blnonlal 
parau*t«r  0  (in  black),  for  sroplo  lit*  n  •  10,  cocporod  with  that  of  •»tinator  «T  of 
Tablo  5.5  (in  rod.  vhoro  different). 
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